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An information processing system comprises 
a user-interface apparatus that includes a plurality of 
functionally different coordinate input devices, each 
being operative to locate a respective one of user- 
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stimulus. The system is rendered downwards 
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Multi-functionality user-interface downwards compatible with single-functionality application 
software. 



FIELD OF THE INVENTION 

The invention relates to an information processing system comprising a user- 
interface apparatus that includes a plurality of functionally different coordinate input devices. 
Each respective one of the devices is operative to locate a respective one of a plurality of user- 
5 generated stimuli for thereupon providing respective data representative of the respective user- 
generated stimulus. The system further comprises processing means coupled to the plurality of 
coordinate input devices for processing of the respective data. 

BACKGROUND ART 

10 Such a system is known, for example, from U.S. Patent 5,231,381 (PHN 13.100) 

issued on a multiple-functionality user-interface, referred to as the PAID device (Philips 
Advanced Interactive Display) manufactured by Philips. The PAID device comprises as a first 
coordinate input device a touch tablet and as a second coordinate input device a graphical tablet 
functionally integrated with the touch tablet. 

15 Data is entered via the touch tablet by the user placing a finger near or on the 

tablet's surface. Typically, a touch tablet is used for menu-driven software applications, wherein 
the user has to point to an item shown on the touch tablet to select a corresponding program. 
The touch tablet is, for example, a capacitive tablet that detects a capacitive coupling between 
the user's finger and a resistive layer. Data is entered via the graphical tablet by the user 

20 manipulating a stylus whose position and displacements are detected and translated into 
coordinates. Software applications for a graphical tablet typically include drawing or handwriting 
recognition. The graphical tablet is, for example, an electromagnetic tablet wherein patterns of 
mutually adjacent electrically conductive loops collaborate with the stylus through an 
electromagnetic coupling. Typically, the touch tablet is used for low positional resolution 

25 applications, whereas the graphical tablet is employed for applications processing high-resolution 
data. 

Selection between finger input mode and stylus input mode may be achieved 
through a user-operated switch or through an automatic detection mechanism to detect the 
presence of the stylus, e.g., by means of a pressure sensor integrated in the stylus or by means 
30 of remote sensing techniques, for reversible switching between finger input mode to stylus input 
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mode. 

The data entered represents the position of the finger or stylus relative to the 
tablet. The touch tablet and the graphical tablet in PAID use physically different sensors. 
Advantages are manifold. There is no cross- talk between the tablets. The tablets are optimized 
5 independently from one another without a compromise stemming from shared hardware, thereby 
giving rise to high performance. The independence is particularly relevant to the integration of 
the input device with an LCD in a layered structure during manufacturing, when the different 
sensors simply are individually merged with the LCD's parts such as the polarizers, leading to 
a reduction in manufacturing cost. The PAID device provides a high performance for a 
10 reasonably price, and accordingly is a highly attractive option in the rapidly expanding market 
of user-interfaces. 

OBJECT OF THE INVENTION 

It is an object of the invention to further enhance the functionalities, notably the 
15 general applicability, of an information processing system having a user-interface apparatus that 
includes a plurality of coordinate input devices. 

SUMMARY OF THE INVENTION 

To this end, the invention provides an information processing system as mentioned 
20 in the preamble above, characterized in that the processing means is operative to run an 

application program, dedicated to a single one of the coordinate input devices, for uniformly 

processing data provided by any of the plurality of coordinate input devices. 

Thus, the system in the invention uses a multi-functionality user-interface rendered 

downwards compatible with single-functionality application software. It will be clear to the 
25 skilled artisan that the character of the coordinate input device, supplying the input data to the 

application, is irrelevant as long as the input data is rendered digestible by the application run 

on the system. A variety of ways to achieve this is discussed below with reference to the 

drawing. 

The invention is based on recognizing that commercially widely available software 
30 typically supports a single kind of coordinate input device only. There is a very large variety 
of joystick-driven applications, such as video games, and of mouse-driven applications, such as 
window-based programs. Similarly, there are touch-only software applications and stylus-only 
software applications. The information processing system in the invention, including a plurality 
of functionally different coordinate input devices, is essentially rendered downwards compatible 
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with existing software for a single type of coordinate input device only. This considerably 
increases the versatility of the system of the invention. 

For instance, a first one of the plurality of coordinate input devices comprises an 
absolute coordinate input device for providing data representative of an absolute coordinate of 
5 a location of a first one of the user-operated stimuli and a second one of the plurality of 
coordinate input devices comprises a relative coordinate input device for providing second data 
representative of a relative displacement of a second one of the user-operated stimuli. The first 
input device is, e.g., a touch tablet or a graphical tablet, whereas the second input device is, 
e.g., a joystick, a mouse or a trackball. The processing means in the invention is operative to 
10 run at least a relative-coordinate application program (for mouse, joystick, trackball) or an 
absolute-coordinate application program (for touch tablet, graphical tablet) and processes both 
the first and second data by virtue of the downwards compatibility. 

In another embodiment, a first one of the plurality of coordinate input devices 
comprises a touch tablet for providing first data representative of a first absolute coordinate of 
15 a location of a user's finger with regard to the touch tablet, and a second one of the plurality 
of coordinate input devices comprises a graphical tablet for providing second data representative 
of a second absolute coordinate of a location of a stylus with regard to the graphical tablet. The 
processing means is operative to run a relative-coordinate application program, e.g., mouse or 
joystick software, to process data provided by any of the tablets, rendered feasible again by 
20 virtue of the downwards compatibility. Thus, the range of usability of a user-interface apparatus 
comprising a touch tablet and a graphical tablet is considerably extended. 

Preferably, the system comprises selection means that is operative to automatically 
select a particular one of the coordinate input devices among the plurality of coordinate input 
devices for providing data to the processing means. This can be implemented, e.g., by having 
25 the selection means performing the following operations. First it is to be determined which ones 
of the plurality of coordinate input devices are actuated simultaneously. Thereupon, it is to be 
determined which one of the simultaneously actuated coordinate input devices is to gain priority 
over each other one of the simultaneously actuated coordinate input devices according to a 
priority scheme. Then the particular one of the coordinate input devices that is to supply its data 
30 to the processing means is chosen as the one gaining the priority. . 

In a further embodiment selection can be accomplished as follows. A first one of 
the plurality of coordinate input devices comprises a touch tablet for providing first data 
representative of a first coordinate of a location of a first user-operated stimulus, corresponding 
with the user's finger, with regard to the touch tablet. A second one of the plurality of 
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coordinate input devices comprises a graphical tablet for providing second data representative 
of a second coordinate of a location of a second user-operated stimulus, corresponding with a 
stylus, with regard to the graphical tablet. The selection means is operative to provide the first 
data to the processing means in a touch mode, and to provide the second data to the processing 
5 means in a stylus mode. The selection means is operative to switch between said modes under 
control of an interaction of one of said first and second stimuli with the user-interface attaining 
a pre-specified magnitude. For example, switching is controlled by the stylus being within a pre- 
specified range from the graphical tablet, a pressure exerted by the graphical tablet on a tip of 
the stylus exceeding a pre-specified threshold, or a force exerted on the touch tablet by the 

10 user's hand exceeding a pre-specified further threshold. 

For example, in an embodiment of the PAID device, the touch tablet and the 
graphical tablet provide data that are representative of both location and force. The touch tablet 
registers not only the x and y coordinates of the touching finger, but also the touch pressure. 
Similarly, the graphical tablet registers, in addition to the x and y coordinates of the stylus tip, 

15 registers the force exerted on the tip. The force information can be supplied to the selection 
means to accomplish the automatic selection between the touch mode and the graphical mode. 
If, e.g. , the force exerted on the tip of the stylus exceeds a pre-specified threshold, the graphical 
tablet is actuated and gains priority over the finger-operated touch tablet. 

The force information in the PAID device can also be used to discriminate 

20 between valid and invalid data entries through thresholding, or to handle either tablet as a 
calligraphic drawing or writing device. In a calligraphic device an increasing force is translated 
into an increasing line width. Now, converting the data provided by the touch tablet as well as 
the data furnished by the graphical tablet into a common digital format renders both tablets 
compatible with finger-only software or stylus only software, both being able to process the 

25 coordinate data as well as the force data. 

Furthermore, the application software can be supplied with extra information, for 
example, indicating which one of the coordinate input devices is acting as the source of data to 
be processed. If the plurality of coordinate input devices includes certain ones supplying high- 
speed data such as a graphical tablet (typically 200 coordinates/sec), and other ones supplying 

30 low-speed data such as a touch screen (typically 100 coordinates/sec), the operation of the 
processing means can be adapted to the accuracy required or processing time available, e.g., in 
order to reduce power consumption or to allow for a plurality of processing tasks performed in 
a time-multiplexed manner. Reducing power consumption is highly relevant to portable, battery 
powered equipment. 
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BRIEF DESCRIPTION OF THE DRAWING 

The invention is described below in further detail and by way of example with 
reference to the accompanying drawing, wherein: 

Fig. 1 shows a diagram a first example of an information processing system in 
5 accordance with the invention; and 

Fig. 2 shows a diagram of a second example of an information processing system 
in accordance with the invention. 

Throughout the figures, like reference numerals indicate similar or corresponding 

features. 

10 

DETAILED DESCRIPTION OF THE EMBODIMENTS 
First example 

Fig. 1 shows an information processing system 100 in accordance with the 

15 invention. System 100 is functionally comprised of a 

user-interface apparatus 102, a selection means 104 and a processing means 106. User-interface 
apparatus 102 includes a plurality of functionally different coordinate input devices, e.g., both 
an absolute-coordinate input device and a relative-coordinate input device. For example, user- 
interface apparatus is provided with two or more of following functionalities: a touch tablet 108, 

20 responsive to the user's finger, and a graphical tablet 110 responsive to a stylus, a joystick 
device 112, a trackball device 114 and a mouse device 116. Touch tablet 108 and graphical 
tablet 1 10 are, for instance, merged with one another as in the PAID device mentioned above. 
Each respective one of devices 108-116 is responsive to a different kind of user-input. Each of 
devices 108-116 provides data that are representative of coordinates of the corresponding user- 

25 operated stimulus. Devices 108-116 are coupled via selection means 104 to processing means 
106, e.g., a host computer, for processing of the data. Selection means 104 selects the data from 
a particular one of devices 108-116 in order to avoid data ambiguity, interference or clashes. 

Processing means 106 is opierative to run an application program 118 to process 
data provided by any of devices 108-116. That is, system 100 is adapted to let the user interact 

30 with a given application program via touch tablet 108 and graphical tablet 110, and also via 
joystick 112, trackball 114 and mouse 116. Assume that application program 118 is written as 
,, mouse H -software. Then there is no substantial problem with regard to interaction via joystick 
112, trackball 114 or mouse 116 as all three are relative-coordinate input devices. Touch tablet 
108 and graphical tablet 110 on the other hand are absolute coordinate devices that, in addition 
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to absolute coordinate data, supply force-related data. It is then required that the data provided 
by touch tablet 108 and by graphical tablet 110 be interpreted correctly by application program 
118 to enable a meaningful interaction of the user with the mouse software loaded into system 
100. 

5 This correct interpretation can be achieved in a variety of ways. A first example 

is to have user-interface 102 supplying data of a particular format only, the format being 
compatible with application program 118. A second example is that selection means 104 or 
processing means 106 translates the received data correctly into the required format, e.g., under 
control of a source identifier that indicates which one of devices 108-116 is acting as a data 
10 source. A third example is a separate interpreter (not shown) inserted somewhere along the data 
path between devices 108-116 and application program 118. A fourth example is a dedicated 
interpreter in software form, e.g., an input device driver, included in processing means 106 
(e.g., host) or in application program 118, or in an on-board controller (not shown) of user- 
interface apparatus 102. 

15 Although Fig. 1 shows user-interface 102, selection means 104 and processing 

means 106 as physically separate functionalities, these may also be merged with one another 
partly or entirely. For example, selection means 104 may be part of processing means 106 or 
of user-interface apparatus 102. Automatic selection can be achieved by establishing a particular 
priority scheme among devices 108-116 to automatically select that one among the actuated 

20 devices, which ranks the highest among the active ones of devices 108-116. The one gaining 
priority then is permitted to supply data to processing means 106. When selection means 104 
is merged with user-interface apparatus 102, contest between touch tablet and graphical tablet 
is avoided by, for instance, detection of the presence of the stylus proximate, i.e., within a pre- 
specified range, to graphical tablet 110 to reversibly disable touch tablet 108. When selection 

25 means 102 is merged with processing means 106, contest may be avoided by a software 
procedure acting as an arbiter according to a predetermined priority scheme. 

Second example 

Fig. 2 shows a second example of an information processing system 200 in the 
30 invention. User-interface apparatus 102 in system 200 comprises a plurality of coordinate input 
devices 108-116 and 202, among which there may be a number of devices with a similar 
functionality, for example, two (or more) graphical tablets 110 and 202. This is an attractive 
feature permitting several users to alternately communicate through user-interface 102, e.g., 
when playing a video game or when sharing the same virtual workspace in computer supported 
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collaborative work. A first selection means 204 is connected to devices 108-116 and 202, and 
is physically integrated in user-interface apparatus 102 for automatically selecting a particular 
one of devices 108-116 and 202 to provide data to processing means 106. User-interface 
apparatus 102 is connected to a first port 206 of processing means 106. First selection means 
5 204 is, for example, implemented in software in a controller of apparatus 102. 

Processing means 106 is provided with one or more further input ports, such as 
second port 208 and third port 210 in this example. Further coordinate input devices such as a 
further mouse 212 and a further joystick 214 can be hooked up to ports 208 and 210. User- 
interface apparatus 102, further mouse 212 and further joystick 214 all provide data to 

10 processing means 106 that is operative to run application program 1 18 to process data provided 
by any of entities 102, 212 and 214. To this end, processing means 106 in system 200 is 
furnished with a second selection means 216, whose function it is to select between the data 
received by either port 206, or 208 or 210 to supply the data at the selected input port to 
application program 118. Thus the selection mechanism is distributed among a plurality of levels 

15 in a hierarchy of coordinate input devices. Second selection means 216 preferably is an input 
device driver in software form selecting between the data received via ports 206-210, e.g., on 
the basis of a pre-specified priority scheme to handle effectively simultaneous access requests. 
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CLAIMS : 



1. An information processing system comprising: 

- a user-interface apparatus that includes a plurality of functionally different coordinate input 
devices, wherein: 

- each respective one of the devices is operative to locate a respective one of a plurality of user- 
5 generated stimuli for thereupon providing respective data representative of the respective user- 
generated stimulus; 

- processing means coupled to the plurality of coordinate input devices for processing of the 
respective data; 

characterized in that 

10 - the processing means is operative to run an application program, dedicated to a single one of 
the coordinate input devices, for uniformly processing data provided by any of the plurality of 
coordinate input devices. 

2. The system of claim 1, wherein the system comprises selection means that is 
operative to automatically select a particular one of the coordinate input devices among the 

15 plurality of coordinate input devices for providing data to the processing means. 

3. The system of claim 2, wherein the selection means is operative to perform 
following operations: 

- determining which ones of the plurality of coordinate input devices are actuated 
simultaneously; 

20 - determining which one of the simultaneously actuated coordinate input devices is to gain 
priority over each other one of the simultaneously actuated coordinate input devices according 
to a priority scheme; . 

- selecting the particular one of the coordinate input devices as the one gaining the priority. 

4. The system of claim 2, wherein: 

25 - a first one of the plurality of coordinate input devices comprises a touch tablet for providing 
first data representative of a first coordinate of a location of a first user-operated stimulus, 
corresponding with the user's finger, with regard to the touch tablet; 

- a second one of the plurality of coordinate input devices comprises a graphical tablet for 
providing second data representative of a second coordinate of a location of a second user- 

30 operated stimulus, corresponding with a stylus, with regard to the graphical tablet; 
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and wherein: 

- the selection means is operative to provide the first data to the processing means in a touch 
mode, and to provide the second data to the processing means in a stylus mode, the selection 
means being operative to switch between said modes under control of an interaction of one of 

5 said first and second stimuli with the user-interface attaining a pre-specified magnitude. 

5. The system of claim 4, wherein the selection means is operative to switch between 
said modes under control of at least one of following interactions: 

- the stylus being within a pre-specified range from the graphical tablet; 

- a pressure exerted by the graphical tablet on a tip of the stylus exceeding a pre-specified 
10 threshold; 

- a force exerted on the touch tablet by a hand of the user exceeding a pre-specified further 
threshold. 

6. The system of claim 1 or 2, wherein 

- a first one of the plurality of coordinate input devices comprises an absolute coordinate input 
15 device for providing data representative of an absolute coordinate of a location of a first one of 

the user-operated stimuli; 

- a second one of the plurality of coordinate input devices comprises a relative coordinate input 
device for providing second data representative of a relative displacement of a second one of the 
user-operated stimuli; 

20 and wherein: 

- the processing means is operative to run at least a relative-coordinate application program or 
an absolute-coordinate application program to process both the first and second data. 

7. The system of claim 1 or 2, wherein 

- a first one of the plurality of coordinate input devices comprises a touch tablet for providing 
25 first data representative of a first absolute coordinate of a location of a user's finger with regard 

to the touch tablet; . 

- a second one of the plurality of coordinate input devices comprises a graphical tablet for 
providing second data representative of a second absolute coordinate of a location of a stylus 
with regard to the graphical tablet; 

30 and wherein: 

- the processing means is operative to run a relative-coordinate application program to process 
data provided by any of the tablets. 

8. A user-interface apparatus provided with the selection means for use in the system 
of claim 2, 3, 4, 6 or 7. 
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